Electronic device and control method thereof

ABSTRACT

Disclosed is an electronic device including: a display; at least one optical lens configured to change an optical path of light generated in the display at a fixed refractive index; a prism configured to reflect the light, which has passed through the at least one optical lens, at least one time to guide the light to a destination point; a variable lens positioned in the optical path of light between the display and the destination point, a refractive index of at least a portion of the variable lens being changed by a control signal to change at least a portion of the optical path of light; and a controller configured to generate the control signal. An optical path of light generated in the display may be changed by the variable lens whose refractive index can be changed.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is the National Phase of PCT International ApplicationNo. PCT/KR2014/009747, filed on Oct. 16, 2014, which claims priorityunder 35 U.S.C. 119(a) to Patent Application Nos. 10-2013-0128817, filedin The Republic of Korea on Oct. 28, 2013, 10-2013-0162832, filed in TheRepublic of Korea on Dec. 24, 2013 and 10-2014-0086972, filed in TheRepublic of Korea on Jul. 10, 2014, all of which are hereby expresslyincorporated by reference into the present application.

TECHNICAL FIELD

The present invention relates to an electronic device and a controlmethod thereof and, more particularly, to an electronic device capableof changing an optical path of light generated in a display by includinga variable lens whose refractive index can be changed, and a controlmethod thereof.

BACKGROUND ART

Recently, wearable computing systems that may be directly installed inusers' body so as to be used has been actively researched andcommercialized. In particular, an electronic device, such as glasses,capable of providing various types of data through glass and providing acellular phone function, a camera function, and the like, in a state inwhich users is wearing it has drawn great attention.

DISCLOSURE OF INVENTION Technical Problem

Therefore, an object of the present invention is to provide anelectronic device capable of changing an optical path of light generatedin a display by including a variable lens whose refractive index can bechanged, and a control method thereof.

Solution to Problem

According to an aspect of the present invention, there is provided anelectronic device including: a display; at least one optical lensconfigured to change an optical path of light generated in the displayat a fixed refractive index; a prism configured to reflect the light,which has passed through the at least one optical lens, at least onetime to guide the light to a destination point; a variable lenspositioned in the optical path of light between the display and thedestination point, a refractive index of at least a portion of thevariable lens being changed by a control signal to change at least aportion of the optical path of light; and a controller configured togenerate the control signal.

According to another aspect of the present invention, there is provideda method for controlling an electronic device, including: sensingwhether the electronic device is worn; when the electronic device isworn, maintaining a pre-set optical path and forming an optical pathpointing toward eyeballs of a user who wears the electronic device; andwhen the electronic device is not worn, changing the preset optical pathto change the optical path such that an image is displayed on a surfaceon which the electronic device is placed.

Advantageous Effects of Invention

According to embodiments of the present invention, the mobile terminalhas the following advantages.

The electronic device and the control method thereof may include thevariable lens whose refractive index can be changed, to thereby changean optical path of light generated in the display.

Additional coverage of applicability of the present invention willbecome apparent from the following description of the embodiments whichis set forth hereinafter. However, various modifications and equivalentswithin the concept and scope of the present invention may be clearlyunderstood by a person skilled in the art, and detailed descriptions andspecific embodiments of the present invention should be understood asbeing merely illustrative.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a block diagram of an electronic device according to anembodiment of the present invention.

FIG. 2 is a perspective view of the electronic device of FIG. 1.

FIG. 3 is a perspective view of the electronic device of FIG. 1according to another embedment of the present invention.

FIG. 4 is a perspective view illustrating an example of a related artglass-type mobile terminal.

FIG. 5 is a view illustrating a principle of forming an image when anelectronic device of FIG. 4 is worn.

FIG. 6 is a view illustrating whether or not an image is formed when theelectronic device of FIG. 4 is not worn.

FIG. 7 is a view illustrating operations of a variable lens of theelectronic device according to an embodiment of the present invention.

FIGS. 8 and 9 are views illustrating display principles of images whenthe electronic device is worn or is not worn.

FIGS. 10 and 11 are views illustrating an operation when the electronicdevice according to an embodiment of the present invention is not worn.

FIGS. 12 and 13 are views illustrating operations of the electronicdevice according to an embodiment of the present invention.

FIG. 14 is a flow chart illustrating a process of operating theelectronic device 100 of FIG. 1.

FIG. 15 is a view illustrating a state in which the electronic device ofFIG. 1 is worn.

FIG. 16 is a flow chart illustrating a process of displaying contentaccording to the second method in the flow chart of FIG. 14.

FIG. 17 is a view illustrating an embodiment of a display state of theelectronic device of FIG. 1.

FIGS. 18 through 20 are views illustrating another embodiment of adisplay state of the electronic device of FIG. 1.

FIG. 21 is a view illustrating another embodiment of the electronicdevice of FIG. 1.

FIGS. 22 and 23 are views illustrating manipulation methods of theelectronic device of FIG. 1 according to an embodiment of the presentinvention.

FIGS. 24 through 28 are views illustrating manipulation methods of theelectronic device of FIG. 1 according to another embodiment of thepresent invention.

FIG. 29 is a flow chart illustrating a process of sensing the currentstate of the electronic device of FIG. 1.

FIG. 30 is a view illustrating methods of sensing the current state ofthe electronic device of FIG. 1.

FIGS. 31 and 32 are views illustrating a sensing method using sensors inthe electronic device of FIG. 1.

FIG. 33 is a view illustrating a sensing method using a camera in theelectronic device of FIG. 1.

FIG. 34 is a view illustrating a sensing method according to states ofeyeglass frame of the electronic device of FIG. 1.

FIG. 35 is a view illustrating a sensing method based on time in theelectronic device of FIG. 1.

FIG. 36 is a view illustrating a sensing method based on charging in theelectronic device of FIG. 1.

MODE FOR THE INVENTION

The aforementioned objects, features and advantages of the presentinvention will become more apparent through the following detaileddescription with respect to the accompanying drawings. Hereinafter, theembodiments of the present invention will be described with reference tothe accompanying drawings, in which like numbers refer to like elementsthroughout the specification. In describing the present invention, adetailed description of known techniques associated with the presentinvention unnecessarily obscure the gist of the present invention, it isdetermined that the detailed description thereof will be omitted. Also,numbers (e.g., “first”, “second,” etc.) used in the description of thepresent disclosure are merely identification symbols for distinguishingone component from another.

Hereinafter, a mobile terminal related to the present invention will bedescribed in detail with reference to the accompanying drawings. In thefollowing description, usage of suffixes such as ‘module’, ‘part’ or‘unit’ used for referring to elements is given merely to facilitateexplanation of the present invention, without having any significantmeaning by itself.

Mobile terminals presented herein may include cellular phones, smartphones, laptop computers, digital broadcast terminals, personal digitalassistants (PDAs), portable multimedia players (PMPs), navigators, andthe like. However, except for a case in which the components accordingto an embodiment described in the present disclosure are applied only tomobile terminals, a person skilled in the art will easily understandthat the present invention is also applied to stationary terminals suchas digital TVs, desktop computers, and the like.

FIG. 1 is a block diagram of an electronic device according to anembodiment of the present invention, and FIG. 2 is a perspective view ofthe electronic device of FIG. 1.

As illustrated in FIG. 1, the electronic device 100 according to anembodiment of the present invention may include a first camera 110, asecond camera 120, glasses 130, a microphone 150, an audio output unit160, a touch sensor 170, a memory 180, a wireless communication unit190, a power supply unit 200, and a projector 210.

The electronic device 100 may be a use wearable device. For example, theelectronic device 100 may be a wearable device such as glasses that usermay wear.

The first camera 110 may be used to capture an external image. The firstcamera 110 may be rotated at a predetermined angle in four directions asneeded. The second camera 120 may be used to capture an image of user'seyes who wears the electronic device 100. The second camera 120 may berotated at a predetermined angle in four directions as needed.

The first camera 110 may capture an external image of a range exceedinguser's visual field. Namely, when a visual field of the user is ‘A’, arange that may be captured by the first camera 110 may be A+a. Forexample, an image ranging at 360 degrees with the user as a centralfigure may be captured through the first camera 110.

A plurality of first cameras 110 may be provided. For example, anappropriate number of first cameras 110 for capturing the front side,the lateral side, and the rear side may be placed in respectivepositions of the electronic device 100.

The first camera 110 may be a wide angle camera. Namely, the firstcamera 110 may be a camera capable of capturing an image at an anglegreater than that of a general camera. When the first camera is a wideangle camera, an external image in an environment surrounding the usermay be extensively obtained.

The glasses 130 may be substantially transparent light general glasses.The user may observe a surrounding environment through the glass 130.Two glasses 130 may be provided to correspond to a left eye and a righteye, or one glass may be provided to correspond to one eye among theleft eye and the right eye.

A transparent display region 131 may be positioned in the glass 130 toprovide information. The controller 140 may control a general operationof the electronic device 100. Namely, the controller 140 may control thecomponents of the electronic device 100 overall. The controller 104 mayanalyze an image captured by the first camera 110 and/or the secondcamera 120. The controller 140 may obtain information regarding a frontobject upon which the user turns his or her eyes, and provide obtainedinformation through the transparent display region 131 provided in theglasses 130. The controller 140 may analyze the image of the user's eyescaptured by the second camera 120, and execute a particular functioncorresponding to a user's eye gesture recognized according to theanalysis result.

The microphone 150 may receive an external audio signal in a phone callmode, a recording mode, a voice recognition mode, and the like, and canprocess such external audio signal into audio data. The microphone 122may implement various types of noise canceling (or suppression)algorithms to cancel noise generated in the course of receiving and anexternal audio signal.

The audio output unit 160 may output audio data. The audio output unit160 may include a receiver, a speaker, a buzzer, and the like. The audiooutput unit 160 may output a sound through an earphone jack (not shown).The user may connect an earphone to an earphone jack to listen to anoutput sound.

The touch sensor 170 may be configured to convert pressure applied to aparticular portion by a touch or a change in the capacitance, or thelike, generated at a particular portion into an electrical input signal.The touch sensor 170 may be configured to detect even the pressure whena touch is applied, as well as the touched position and area. The touchsensor 170 may be implemented as a proximity sensor. Input data throughthe touch sensor 170 may be used to perform a particular function of theelectronic device 100.

The memory 160 may store programs operations performed by the controller140, or may temporarily and/or permanently store data (e.g., aphonebook, messages, still images, video, etc.) that are inputted oroutputted.

The memory 160 may include at least one type of storage medium includinga flash memory, a hard disk, a multimedia card micro type, a card-typememory (e.g., SD or DX memory, etc), a random access memory (RAM), astatic random access memory (SRAM), a read-only memory (ROM), anelectrically erasable programmable read-only memory (EEPROM), aprogrammable read-only memory (PROM), a magnetic memory, a magneticdisk, and, an optical disk. The electronic device 100 may be operated inrelation to a web storage device that performs the storage function ofthe memory 160 over the Internet.

The wireless communication unit 190 typically includes one or moremodules allowing radio communication between the electronic device 100and a wireless communication system. For example, the wirelesscommunication unit 190 may include a broadcast receiving module, amobile communication module, a wireless Internet module, a short-rangecommunication module, a location information module, and the like.However, a selection of wireless communication-related modules that maybe included in the wireless communication unit 190 is not limitedthereto.

The sensor unit 170 may sense a state of the electronic device 100. Forexample the sensor unit 170 may sense a direction in which the user whowears the electronic device 100 looks, a level at which the user looks,whether there is a rotation, whether a movement is made forwards orbackwards, or the like. The sensor unit 170 may include at least oneamong a posture sensor, a geomagnetic sensor, and an accelerometer. Thecontroller 140 may sense a state of the electronic device 100 and/or acurrent state of the user who wears the electronic device 100 based on aresult value sensed by at least one sensor.

The power supply unit 200 supplies power required for operations of thecomponents upon receiving external power or internal power under thecontrol of the controller 140.

The projector 210 may project an image. For example, in a particularsituation, the projector 210 may project content to an externalprojection surface in a particular situation. The controller 140 mayselectively output an image to at least one among the projector 210 andthe transparent display region 131. For example, in a state in which theelectronic device 100 is worn, the controller 140 may output an imagethrough the transparent display region 131, and in a state in which theelectronic device 100 is not worn, the controller 140 may output animage through the projector 210.

The projector 210 may include a first projector 212 and a secondprojector (214 in FIG. 17). The first projector 212 and the secondprojector (214 in FIG. 17) may project images in different directions.For example, the first projector 212 may project an image toward a frontsurface of the electronic device 100, and the second projector (214 inFIG. 17) may project an image toward a rear surface of the electronicdevice 100. Which of the first and second projectors 212 and 214 (inFIG. 17) is to be used to project an image may be determined by acontrol signal from the controller 140 of the electronic device 100. Forexample, which of the first and second projectors 212 and 214 (in FIG.17) is to be used to project an image may be determined according to astate of the electronic device 100. An operation of the projector 210will be described in detail in a pertinent portion.

The electronic device 100 may be divided into a body 141 and eyeglassframes 161.

The body 141 may be a portion forming the front surface of theelectronic device 100. The body 141 may include cameras 110 and 120, theglasses 130, the transparent display region 131, and the controller 140.

The transparent display region 131 may be positioned in the each of theglasses 130 or one side of the glasses 130. For example, first andsecond transparent display regions 131 a and 131 b may be provided inthe glasses 130, respectively.

The eyeglass frames 161 may be coupled to the body 141. The eyeglassframes 161 may rotate on a hinge 171. Namely, the eyeglass frames 161may rotate on the hinge 171 in a clockwise direction or in acounterclockwise direction. Thus, at least one of first and secondeyeglass frames 161 a and 161 b may rotate in the counterclockwisedirection so as to be folded in an inward direction of the body 141 ormay rotate in the clockwise direction so as to be folded in an outwarddirection of the body 141.

FIG. 3 is a perspective view according to another embodiment of thepresent disclosure.

As illustrated in FIG. 3, the electronic device 100 according to anotherembodiment of the present disclosure may have a different configuration.

The electronic device 100 may not include the glasses (such as theglasses 130 of FIG. 2). For example, the electronic device 100 mayinclude the body 141 and the eyeglass frames 161 to have a glass type,but glasses (130 of FIG. 2) are not coupled to the body 141.

The electronic device 100 may project an image through the projector 210such that the user may recognize it. For example, in a state in whichthe electronic device 100 is worn, the projector 210 may project animage directly to the user's eyeballs. Thus, the glasses (130 of FIG. 2)or the transparent display region (131 of FIG. 2) may not be required.Since the glasses (130 of FIG. 2) are not present, the electronic device100 may be more naturally worn.

FIG. 4 is a perspective view illustrating an example of a related artglass-type mobile terminal.

The glass-type mobile terminal 100 may be configured to be worn on ahuman being's head part and may include a frame unit (case, housing, andthe like). The frame unit may be formed of a flexible material so as tobe easily worn. In FIG. 4, it is illustrated that the frame unitincludes a first frame 101 and a second frame 102. In general, themobile terminal 100 may have characteristics identical or similar tothose of the electronic device 100 of FIGS. 1 to 3.

The frame unit is supported by the head part and provides a space inwhich various components are installed. As illustrated, a control module180, an audio output module 152, and the like, may be installed in theframe unit. Also, a lens 103 covering at least one among a left eye anda right eye may be detachably installed in the frame unit.

The control module 180 may control various electronic componentsprovided in the mobile terminal 100. The control module 180 may beunderstood as a component corresponding to the controller 140 describedabove. In FIG. 4, it is illustrated that the control module 180 isinstalled on one side of the frame unit on the head part. However, theposition of the control module 180 is not limited thereto.

A prism 206 may reflect light generated in a display 202 of FIG. 3 atleast one time to guide the light to a destination point. Namely, theprism 206 may serve to substantially change an optical path of light todirectly display an image in front of the user's eyes to project animage to the user's eyes.

The image output to the user's eyes through the prism 206 may bedisplayed to overlap a general visual field. Using such displaycharacteristics, the mobile terminal 100 may provide augmented reality(AR) by superposing a virtual image onto an image of reality or avirtual image to display a single image.

A camera 121 may be disposed to be adjacent to at least one of the lefteye and the right eye to capture a front image. Since the camera 121 ispositioned to be adjacent to the eyes, the camera 121 may obtain a scenethat the user looks, as an image.

In FIG. 4, it is illustrated that the camera 121 is provided in thecontrol module 180, but the present invention is not limited thereto.The camera 121 may be installed in the frame unit, or a plurality ofcameras 121 may be provided to obtain a stereoscopic image.

The glass-type mobile terminal 100 may include user input units 123 aand 123 b manipulated to receive a control command. The user input units123 a and 123 b may employ any tactile method that allows the user toperform manipulation such as touch, push, scroll, or the like. In thedrawing, it is illustrated that touch input type user input units 123 aand 123 b are provided in the frame unit and the control module 180,respectively.

Also, the glass-type mobile terminal 100 may include a microphone (notshown) receiving a sound and processing it to electrical audio data andan audio output module 152 outputting a sound. The audio output module152 may be configured to transmit a sound in a general sound outputmanner or a bone conduction manner. In a case in which the audio outputmodule 152 is implemented in a bone conduction manner, when the userwears the mobile terminal 100, the audio output module 152 is tightlyattached to his or her head part and his or her skull may be vibrated totransmit a sound.

Hereinafter, embodiments related to a control method that may beimplemented in the mobile terminal configured as described above will bdescribed with reference to the accompanying drawings. It will beobvious to a person skilled in the art that the present invention isembodied to any other particular form within the scope of the spirit andessential characteristics of the present invention.

FIG. 5 is a view illustrating a principle of forming an image when theelectronic device of FIG. 4 is worn.

As illustrated in (a) of FIG. 5, the related art glass-type electronicdevice 100 may be glasses that are worn on the user's head H. The usermay recognize an image generated by the image generating unit 200 of theelectronic device 100 through his or her eyes E.

As illustrated in (b) of FIG. 5, light generated in a display 202 may betransmitted to the user through a predetermined path.

The display 202 may display a first image I1. The first image I1displayed on the display unit 202 may be an image that the imagegenerating unit 202 wants to transmit to the user.

An optical lens 204 may change an optical path of the first image I1displayed on the display 202. For example, the optical lens 204 mayinclude a least one concave lens and/or convex lens.

A lens of the optical lens 204 may be configured to form an optical pathfor an image to fall on the retina RE of the user's eye E. Namely, inconsideration of the general user's eye lens EL serving as a convexlens, the optical lens 204 may include a combination of at least oneconcave lens and/or convex lens to allow light that has passed throughthe eye lens EL to fall on the retina RE to form a second image I2.

The prism 206 may reflect light refracted upon passing through theoptical lens 204 at least one time and guide the light to a destinationpoint. Light, which passes through the optical lens 204 and is madeincident to the prism 206, may travel along a path in which it istotally internally reflected, to reach a reflector 208.

The reflector 208 may reflect the light, which has traveled along theprism 206, toward the eyeball E. The reflector 208 may be configured asa half mirror.

Light reflected from the reflector 208, which forms first and secondoptical paths L1 and L2, may point toward the eye lens EL. Inconsideration of the eye lens EL serving as a convex lens, the first andsecond optical paths L1 and L2 may have an emanated form. Namely, as theemanated first and second optical paths L1 and L2 pass through the eyelens EL, the first and second optical paths L1 and L2 may be changedinto third and fourth optical paths L3 and L4 in a converged form. Theconverted third and fourth optical paths L3 and L4 may fall on theretina RE to form an image. Namely, the third and fourth optical pathsL3 and L4 may generate a second image I2 substantially identical to thefirst image I1.

FIG. 6 is a view illustrating whether or not an image is formed when theelectronic device of FIG. 4 is not worn.

As illustrated, when the electronic device 100 is not worn, a virtualimage is created and the user may not recognize the image.

A first image I1 displayed on the display 202 may be transmitted throughthe optical lens 204, the prism 206, and the reflector 208. Paths oflight which has passed through the reflector 208 may be first and secondpaths L1 and L2. The first and second optical paths L1 and L2 may havean emanated form. The emanated first and second optical paths may bepaths on the assumption of the presence of the eye lens EL as mentionedabove. Thus, without wearing the electronic device 100, since the eyelens EL is not present within a predetermined distance from the prism206, a third image I3 of the ground GR may be a virtual image. Thus, aproblem may arise in that the third image I3 cannot be visuallyrecognized.

FIG. 7 is a view illustrating operations of a variable lens of theelectronic device according to an embodiment of the present invention.

As illustrated, the electronic device according to an embodiment of thepresent invention may include a variable lens 210.

As illustrated in (a) to (c) of FIG. 7, the variable lens 210 mayperform different operations according to voltages and/or currentsapplied thereto. For example, when a voltage Va is applied, opticalpaths of incident light R1 and output light RO may be identical, and inthis case, both the side of the incident light RI of the variable lens210 and the side of the output light RO of the variable lens 210 areflat.

When the voltage is changed to Vb, the side of the output light RO ofthe variable lens 210 may be changed to be convex. When the side of theoutput light RO of the variable lens 210 is changed to be convex, theoutput light RO may be refracted in a converged direction. Namely, thevariable lens 210 may operate like a convex lens.

When the voltage is changed to Vc, the side of the output light RO ofthe variable lens 210 may be changed to be concave. When the side of theoutput light RO of the variable lens 210 is changed to be concave,output light RO may be refracted in an emanated direction. Namely, thevariable lens 210 may operate like a concave lens.

The voltage Vb may be greater than the voltage Va, and the voltage Vcmay be greater than the voltage Vb. Namely, the applied voltages mayhave a certain relationship.

As illustrated in (d) of FIG. 7, the variable lens 210 may be changed toan atypical state. For example, the variable lens 210 may be changedsuch that output light RO is refracted in a particular direction.

A substantially transparent liquid may be charged in the variable lens210. The liquid may be electrolytic. The electrolytic liquid may bechanged in shape depending on a voltage applied thereto. When the shapeof the liquid is changed, an optical path of light that passes throughthe liquid may be changed.

An attribute of the variable lens 210 changed according to a change in avoltage may be changed substantially at the same time when a voltage isapplied. Thus, the variable lens 210 may be rapidly changed depending onwhether the electronic device 100 is worn.

The attribute of the variable lens 210 may be changed by at least one ofa change in an applied voltage, a change in an applied current, and achange in an applied control signal. For example, an attribute of thevariable lens 210 may be changed from an attribute of a convex lens toan attribute of a concave lens according to a change in an appliedvoltage. Or, an attribute of the variable lens 210 may be changed by acombination of a voltage, a current, and a control signal.

FIGS. 8 and 9 are views illustrating display principles of images whenthe electronic device is worn or is not worn.

As illustrated in FIGS. 8 and 9, the electronic device 100 according toan embodiment of the present invention may form an image even in a statein which the electronic device 100 is not worn, as well as in a state inwhich the electronic device 100 is worn.

As illustrated in FIG. 8, in a state in which the electronic device 100is worn, a first image I1 may be displayed on the display 202.

The controller 140 may sense whether the electronic device 100 is worn.For example, the controller 140 may sense whether the electronic device100 is worn through a contact sensor installed in the electronic device100. Alternatively, the controller 140 may sense whether the electronicdevice 100 is worn through a proximity sensor and/or a touch sensorinstalled in the electronic device 100. In this case, the contactsensor, the proximity sensor, and/or the touch sensor may be provided ina nose support in contact with the user's nose, a frame in contact withthe head of the user's ear part, and the like. Alternatively, thecontroller 140 may sense whether the electronic device 100 is worn bysensing a user's movement through an accelerometer.

When the user's movement is sensed for more than a predetermined periodof time or when the user's nose in contact with the nose support issensed through the contact sensor for more than a predetermined periodof time, the controller 140 may determine that the user is wearing theelectronic device 100.

When it is determined that the electronic device 100 is worn, thecontroller 140 may change an attribute of the variable lens 210 into aparticular state. For example, fifth and sixth optical paths 15 and 16made incident to the variable lens 210 may be output as seventh andeighth optical paths 17 and 18, without being changed. Namely, theoptical paths may not be changed by the variable lens 210.

Since the optical paths are not changed by the variable lens 210, theoptical paths may be formed as if there is no variable lens 210. Thus,light that passes through the variable lens 210 and the prism 206 mayform the first and second optical paths L1 and L2 and are made incidentto the eye lens EL to finally form a second image I2 on the retina RE.

As illustrated in FIG. 9, in a state in which the electronic device 100is not worn, a first image I2 may be displayed on the display 202.

When it is determined that the electronic device 100 is not worn, thecontroller 140 may change an attribute of the variable lens 210accordingly. For example, the controller 140 may apply a control signalto the variable lens 210 so that the variable lens 210 can have anattribute of a convex lens.

When the attribute of the variable lens 210 is changed, seventh andeighth optical paths L7 and L8 which have passed through the variablelens 210 may be changed. For example, the seventh and eighth opticalpaths L7 and L8 may be changed to a converged form. When the seventh andeighth optical paths L7 and L8 are changed, first and second opticalpaths L1 and L2 which point toward the ground GR after passing throughthe prism 206 and the reflector 208 may be changed. For example, thefirst and second optical paths L1 and L2 may be changed to form a realimage.

When the first and second optical paths L1 and L2 are changed to form areal image, a fourth image I4 may be generated on the ground GR. Thus,the user may be able to observe the image by the controller 140 evenwithout wearing the electronic device 100

The fourth image I4 may be changed according to a state of the groundGR, or the like. For example, the controller 140 may change the size ofthe fourth image I4 according to distances to the ground GR, distancesto the user, and the like. Also, the controller 140 may change at leastone of a color and a display position of the fourth image I4 accordingto states of the ground GR.

FIGS. 10 and 11 are views illustrating an operation when the electronicdevice according to an embodiment of the present invention is not worn.

As illustrated in FIGS. 10 and 11, the electronic device 100 accordingto an embodiment of the present invention may effectively transmitinformation to the user even in a state in which the electronic device100 is not worn and placed on the ground GR.

As illustrated in (a) of FIG. 10, the electronic device 100 may displayan image IM in a first region A1. For example, the electronic device 100may display an image IM indicating reception of a new message in thefirst region A1.

As illustrated in (b) of FIG. 10, the electronic device 100 may displayan image IM in a second region A2. The second region A2 may be aselective display region. For example, when it is determined that it isnot desirable to display an image IM in the first region A1, thecontroller 140 may display the image IM in the second region A2, ratherthan in the first region A1. Displaying the image IM the first region A1is not desirable may relate to a color, a material, and the like, of theground GR corresponding to the first region A1. For example, in a casein which the ground GR corresponding to the first region A1 is toobright or too dark to identify the displayed image IM, the image IM maybe displayed in the second region A2, rather than in the first regionA1.

As illustrated in FIG. 11, the electronic device 100 according to anembodiment of the present invention may adjust an angle of light emittedfrom the prism 206. For example, based on the prism 206, light may beirradiated toward the ground GR at various angles in a first directionD1, a second direction D2, a third direction D3, and the like, to forman image. The irradiation angles in the first to third directions D1 toD3 may be adjusted by operating the variable lens 210. Namely, anirradiation direction of an image may be changed by changing thevariable lens 210 to an atypical state.

FIGS. 12 and 13 are views illustrating operations of the electronicdevice according to an embodiment of the present invention.

As illustrated in FIGS. 12 and 13, the controller 140 of the electronicdevice 100 according to an embodiment of the present invention may sensethe current state of the electronic device 100 (S10).

The electronic device 100 may be a wearable device that may be worn onthe user's body. In particular, the electronic device 100 may be aglass-type wearable device.

The electronic device 100 may be worn or may not be worn. For example,the electronic device 100 may be placed on the ground for a chargingoperation.

It is determined whether the electronic device 100 is worn (S20). Whenit is determined that the electronic device 100 is worn, a presetoptical path is maintained (S30).

The optical path may exist as default when the electronic device 100 isworn. Thus, in order to maintain the preset optical path, the controller140 may apply a control signal to the variable lens 210 such that pathsof incident light and output light in the variable lens 210 are notchanged.

When the electronic device 100 is not worn, the preset optical path maybe changed (S40).

When the electronic device 100 is not worn, if an optical path ismaintained like the case in which the electronic device 100 is worn, avirtual image may be created and the user may not be able to recognizean image. Thus, when it is determined that the electronic device 100 isnot worn, the controller 140 may apply a control signal to the variablelens 210 to change a path of output light with respect to incident lightof the variable lens 210. When the optical path is changed, a real imagemay fall on the ground.

The changing of an optical path (S40) may include determining anirradiation position of an image (S42).

The controller 140 may determine to which position of the ground lightis to be irradiated to form an image. As the irradiation position, aparticular position may be set as a default value. For example, aparticular position away from the electronic device 100 by a particulardistance may have been set to which light is to be irradiated to form animage.

The controller 140 may sense a state of a particular region. Forexample, the controller 140 may sense a color, a material, or the like,of the particular region by using a camera, or the like. Based on thesensing result, the controller 140 may determine whether a particularregion is appropriate for light to be irradiated thereto to form animage. When it is determined that a particular region is not appropriatefor light to be irradiated thereto to form an image, the controller 140may determine other region as an image formation position.

Based on the image formation position, the controller may apply acontrol signal to the variable lens (S44).

The controller may apply a control signal to the variable lens to changea position to which an image is projected. For example, the controller140 may change a projection angle to change a position to which an imageis projected.

FIG. 14 is a flow chart illustrating a process of operating theelectronic device 100 of FIG. 1.

As illustrated in FIG. 14, the controller 140 of the electronic device100 may sense the current state of the electronic device 100 (S10).

The electronic device 100 may be in various states. Among the variousstates of the electronic device 100, a state in which the electronicdevice 100 is worn may be defined as a first state, and a state in whichthe electronic device 100 is not worn may be defined as a second state.

The current state of the electronic device 100 may be sensed by thesensor unit 170. For example, whether the electronic device 100 is wornmay be sensed through a sensor at a point in which the electronic device100 is in contact with the user's nose, a sensor at a point in which theeyeglass frames 161 are in contact with the user's head, and the like.

The current state of the electronic device 100 may be sensed through amotion recognition sensor. For example, when the electronic device 100is worn, a motion of the electronic device 100 may be sensed through anaccelerometer and/or a geomagnetic sensor.

The current state of the electronic device 100 may include sensingregarding a state of the eyeglass frames 161. For example, whether atleast one of the first and second eyeglass frames 161 a and 161 b isunfolded or folded may be sensed. The state of the eyeglass frames 161may be sensed through a position sensor positioned at the hinge betweenthe eyeglass frames 161 and the body 141.

The current state of the electronic device 100 may be sensed through atleast one of the first and second cameras 110 and 120. For example,whether the user wears the electronic device 100 may be determined byanalyzing a captured image.

The controller 140 may determine whether the electronic device 100 isworn (S20), and when the electronic device 100 is worn, the controller140 may display content according to a first method (S30).

The displaying according to the first method may be a display methodoptimized for the state in which the electronic device 100 is worn. Forexample, content may be displayed through the first and secondtransparent display regions 131 a and 13 b of the glasses 130 or contentmay be directly projected to the user's eyeballs through the projector210.

The controller 140 may determine whether the electronic device 100 isworn (S20), and when the electronic device 100 is not worn, thecontroller 140 may display content according to a second method (S40).

The displaying according to the second method may be a display methodoptimized for a state in which the electronic device 100 is not worn.

When the electronic device 100 is not worn, generally, the electronicdevice 100 may be placed on the ground. When the electronic device 100is placed on the ground, when content is displayed on the glasses, itmay be difficult for the user to recognize the displayed content. Thus,in the second state, the controller 140 may change a display method ofcontent such that user may conveniently recognize the content.

FIG. 15 is a view illustrating a state in which the electronic device ofFIG. 1 is worn.

As illustrated in FIG. 15, the electronic device 100 according to anembodiment of the present invention may be worn on the face of the userU. When the electronic device 100 is worn on the user's face, the body141 may be supported by the user's nose and the first and secondeyeglass frames 161 a and 161 b may be supported by the user's ears.

The user U may observe the exterior through the glasses 130 and thetransparent display region 131. For example, information displayedthrough the transparent display region 131 may be displayed on anexternal object viewed through the glasses 130, in the form of augmentreality.

FIG. 16 is a flow chart illustrating a process of displaying contentaccording to the second method in the flow chart of FIG. 14.

As illustrated in FIG. 16, the controller 140 of the electronic device100 according to an embodiment of the present invention may displaycontent according to the second method in consideration of variousconditions. The electronic device 100 according to an embodiment of thepresent invention may display content in a manner of projecting thecontent by using the projector 210 in a state in which the electronicdevice 100 is not worn. Namely, the content may be projected to theground, or the like, to allow the user to easily recognize it. In thiscase, the projected image may be adjusted to reflect a situation of theground, or the like, so as to be appropriately delivered to the user.

The controller 140 may display content depending on a location where theelectronic device 100 is placed (S42).

The location where the electronic device 100 is placed may vary. Forexample, a material, a color, and the like, of the location where theelectronic device 100 is placed may vary.

A state of the ground may be sensed through the sensor unit 170 and/orthe cameras 110 and 120. For example, a state of the ground may besensed by analyzing an image of the ground captured through the cameras110 and 120.

When a material of the ground is smooth, rather than being rough, so aprojected image is easily recognized, the controller 140 may display alarge amount of information. For example, when a material of the groundis appropriate for an image to be projected thereto, the controller 140may use a smaller font. When a material of the ground is appropriate foran image to be projected thereto, the controller 140 may use morevarious colors.

When a color of the ground is bright, the controller 140 may project animage more brightly. When a color of the ground is dark, the controller140 may project an image relatively darkly.

The controller 140 may display content depending on a direction in whichthe electronic device 100 is placed (S44).

The electronic device 100 may be placed such that a front surface or arear surface thereof faces the user. Alternatively, the electronicdevice 100 may be placed such that a lower surface or an upper surfacethereof is in contact with the ground. Based on the result of sensingthrough the sensor unit 170 and/or the cameras 110 and 120, thecontroller 140 may determine a direction in which the electronic device100 is placed. The controller 140 may display an optimized imagedepending on the direction in which the electronic device 100 is placed.

The controller 1400 may display content according to gestures withrespect to the electronic device 100 (S46).

The user may make a particular gesture in front of the cameras 110 and120 of the electronic device 100 or may make a gesture of being indirect contact with a particular portion of the electronic device 100.In response to the direct or indirect gesture with respect to theelectronic device 100, the controller 140 may change a method ofdisplaying content.

The controller 140 may display content differently according to types ofcontent to be displayed through the electronic device 100 (S48).

Content to be displayed through the electronic device 100 may vary. Forexample, a received message, a received call, various text, variousvideo, and the like, may be variously displayed through the electronicdevice 100. Content to be displayed through the electronic device 100may be displayed in different manners according to attributes of thecontent. Namely, content may be displayed in a manner optimizedtherefor.

FIG. 17 is a view illustrating an embodiment of a display state of theelectronic device of FIG. 1.

As illustrated in FIG. 17, the electronic device 100 according to anembodiment of the present invention may display content DF in differentmanners according to directions in which the electronic device 100 isplaced.

As illustrated in (a) of FIG. 17, in the second state in which theelectronic device 100 is not worn, a lower portion 172 of the body ofthe electronic device 100 and/or a lower portion 174 of the eyeglassframes 161 may be in contact with the ground.

The electronic device 100 may include a position sensor and/or ageomagnetic sensor. The controller 140 of the electronic device 100 maysense a state in which the electronic device 100 is placed through theposition sensor and/or the geomagnetic sensor.

A pressure sensor may be positioned in the lower portion 172 of the bodyof the electronic device 100 and/or the lower portion 174 of theeyeglass frames 161. Namely, a state in which the lower portion 172 ofthe body of the electronic device 100 and/or the lower portion 174 ofthe eyeglass frames 161 are in contact with the ground may be sensedthrough the pressure sensor.

The controller 140 may display content DF to correspond to a directionof the user. For example, a location of the user may be sensed byanalyzing an image captured through the cameras 110 and 120. When thelocation of the user is sensed, the controller 140 may project contentDF to a projection surface DE by using the projector. For example, thecontroller 140 may display the content DF by using the second projector214 corresponding to the direction in which the user is located.

As illustrated in (b) of FIG. 17, in the second state in which theelectronic device 100 is not worn, an upper portion 178 of the body ofthe electronic device 100 and/or an upper portion 176 of the eyeglassframes 161 may be in contact with the ground.

The controller 140 may determine a direction in which content DF is tobe displayed. For example, the controller 140 may determine a directionappropriate for displaying the content DF among a direction of the frontside and a direction of the rear side of the electronic device 100 byusing the cameras 110 and 120, and the like.

When the direction is determined, the controller 140 may display thecontent DF such that it is viewed properly in the direction in which theuser views it. Namely, the controller 140 may display the content DFsuch that the direction in which the user views the content DF and avertical direction of the content DF are aligned. Thus, orientation ofthe content viewed by the user may be uniform, regardless of directionin which the electronic device 100 is placed. Namely, the controller 140may project content such that the orientation of the content is uniformwith respect to the direction of the user's eyes, regardless ofdirection in which the electronic device 100 is placed.

FIGS. 18 through 20 are views illustrating another embodiment of adisplay state of the electronic device of FIG. 1.

As illustrated in FIGS. 18 through 20, the controller 140 of theelectronic device 100 according to another embodiment of the presentinvention may change a display state of content DF according to statesof the ground G such as a color and/or a material of the ground G.

As illustrated in (a) of FIG. 18, the ground G on which the electronicdevice 100 is placed may have various colors. Thus, if the variouscolors of the ground G are not considered, a situation in which someportions of the content DF are easily recognized while others are notmay occur.

As illustrated in (b) of FIG. 18, the controller 140 may change a methodof displaying the content DF according to the states of the ground G.For example, when the ground G has various colors, the controller 140may display the content DF by correcting brightness and/or colorsthereof based on a dark color or a bright color. By correcting thecolors, recognition of the displayed content DF may be increased.

As illustrated in (a) of FIG. 19, the ground G may be appropriate for animage to be projected thereto. For example, the ground G may be formedof a smooth material to allow an image projected thereto to be easilyrecognized. When the ground G is in a state of facilitating recognitionof an image, the controller 140 may display the content DF minutely.

As illustrated in (b) of FIG. 19, the ground G may not be appropriatefor an image to be projected thereto. In a case in which the ground isuneven, or the like, so it is not appropriate for the content DF to bedisplayed thereon, the controller 140 may change a display state of thecontent DF. For example, the controller 140 may perform at least oneamong an operation of increasing the font of the content DF, anoperation of adjusting an amount and/or type of information of thecontent DF by deleting information having low importance, and anoperation of simplifying coloration. Even with the same information, thecontroller 140 may display the content DF differently according tostates of the ground G to increase user recognition with respect to thecontent DF.

As illustrated in FIG. 20, the controller 140 may display content DFappropriately depending on brightness of the ground G.

As illustrated in (a) of FIG. 20, the ground G may have a bright color.When the ground G has a bright color, the controller 140 may display thecontent DF by using various light and shade and/or colors.

As illustrated in (b) of FIG. 20, the ground G may have a dark color.When the ground G has a dark color, the controller 140 may displaycontent DF by using simple light and shade and/or colors. Thus, userrecognition with respect to the content DF may be increased.

FIG. 21 is a view illustrating another embodiment of the electronicdevice of FIG. 1.

As illustrated in FIG. 21, the electronic device 100 according toanother embodiment of the present invention may change displaying of theglasses 130 according to states of the eyeglass frames 161.

As illustrated in (a) of FIG. 21, the eyeglass frames 161 may beunfolded. Namely, both the first and second eyeglass frames 161 a and161 b may be positioned in a direction of about 90 degrees with respectto the body 141. When both the first and second eyeglass frames 161 aand 161 b are unfolded, the controller 140 may determine that the useruses the glasses 130. Thus, the controller 140 may activate the glasses130. For example, the controller 140 may display an image through thetransparent display region 131.

As illustrated in (b) of FIG. 21, one of the eyeglass frames 161 may befolded. For example, the first eyeglass frame 161 a may be folded in adirection toward the body 141, and the second eyeglass frame 161 b maybe unfolded at about 90-degree direction with respect to the body 141.In consideration of the fact that the first eyeglass frame 161 a isfolded, the controller 140 may deactivate the glass 130 corresponding tothe first eyeglass frame 161 a. For example, the controller 140 maydeactivate the first transparent display region 131 a of the firsteyeglass frame 161 a side.

As illustrated in (c) of FIG. 21, when the second eyeglass frame 161 bis folded, the controller 140 may deactivate the second eyeglass frame161 b corresponding thereto.

As illustrated in (d) of FIG. 21, when both the first and secondeyeglass frames 161 a and 161 b are folded, the controller 140 maydeactivate both glasses 130. Namely, when both the eyeglass frames 161are folded, the controller 140 may determine that the user has nointention to use the electronic device 100. Thus, when both the eyeglassframes 161 are folded or when a predetermined period of time has elapsedsince the eyeglass frames 161 were folded, the controller 140 maydeactivate the glasses 130. For example, the controller 140 may stopdisplaying of an image through the transparent display region 131.

FIGS. 22 and 23 are views illustrating manipulation methods of theelectronic device of FIG. 1 according to an embodiment of the presentinvention.

As illustrated in FIGS. 22 and 23, the electronic device 100 accordingto an embodiment of the present invention may adjust a display region DAin response to a user's gesture.

As illustrated in (a) of FIG. 22, the display region DA may be a singleregion. Content may be displayed in the entirety of the single regionDA.

The controller 140 may receive a particular gesture from the user. Forexample, the controller 140 may receive a gesture of touching the secondglass 130 b, a particular glass 130, or a gesture of moving the user'sfingers in a touched state in a predetermined direction.

As illustrated in (b) of FIG. 22, when a particular gesture is receivedfrom the user, the controller 140 may divide the display region DA. Forexample, the controller 140 may divide the display region DA into afirst display region DA1 corresponding to the first glass 130 a and asecond display region DA2 corresponding to the second glass 130 b.Namely, the controller 140 may change the width and/or the number ofdisplay regions DA in which content is to be displayed according toattributes of content and/or a user input.

As illustrated in (a) of FIG. 23, the controller 140 may receive anothergesture from the user. For example, the controller 140 may receive agesture of touching the first glass 130 a or a gesture of moving theuser's fingers in a touched state in a predetermined direction.

As illustrated in (b) of FIG. 23, the controller 140 may merge divideddisplay regions into a display region DA in response to a user's touchinput.

FIGS. 24 through 28 are views illustrating manipulation methods of theelectronic device of FIG. 1 according to another embodiment of thepresent invention.

As illustrated in FIGS. 24 through 28, the electronic device 100according to an embodiment of the present invention may effectivelydisplay content in a projected region in various situations.

As illustrated in (a) of FIG. 24, in the second state in which theelectronic device 100 is not worn, a new message may be received. Whenthe controller 140 senses that the electronic device 100 is in thesecond state, the controller 140 may display the reception of themessage in the display region DA. Namely, assuming that the user is awayfrom the electronic device 100 by a predetermined distance, thecontroller 140 may display the reception of the message on the ground,rather than on the glass 130, increasing user recognition.

The controller 140 may display the fact that a message has beenreceived, as a character and/or character icon I1. When there is nomanipulation from the user, the controller 140 may display the characterand/or the character icon I1 for a predetermined period of time,starting from the point in time at which the character was received, andstop displaying of the display region DA.

As illustrated in (b) of FIG. 24, in the second state, a call may bereceived. The controller 140 may display the reception of the call as atext and/or a call icon I2.

As illustrated in (a) of FIG. 25, the user may make a predeterminedgesture with his fingers F with respect to the electronic device 100.For example, the user may make a gesture of touching the glass 130 ofthe electronic device 100.

When the user makes the gesture, the controller 140 may activate thedeactivated display region DA. Namely, an image may be projected byusing the projector 210.

As illustrated in (b) of FIG. 25, when a particular gesture input isreceived from the user, the controller 140 may sequentially displayevents which have been received but not checked by the user. Forexample, the controller 140 may display a call icon I2 indicating thatthere is a call not checked yet in one region.

As illustrated in (a) of FIG. 26, the user may make a predeterminedgesture with his fingers F, or the like, in the electronic device 100.For example, the user may make a motion of touching the eyeglass frameof the electronic device 100.

As illustrated in (b) of FIG. 26, in response to the user's touchoperation, the controller 140 may display contents of an event that theuser has not checked yet. For example, the controller 140 may display amessage icon I1 and/or a character.

As illustrated in (a) of FIG. 27, when the electronic device 100 is inthe second state, a message may be received. The controller 140 maydisplay the message icon I1, or the like, in order to indicate that amessage reception event has occurred.

As illustrated in (b) of FIG. 27, in a case in which a particular event,such as reception of the message icon I1, occurs, the user may wear theelectronic device 100 and perform a follow-up operation. In this case,the user may grasp the eyeglass frames 161 and wear the electronicdevice 100. For example, the user may grasp first and second touchpoints TP1 and TP2 to wear the electronic device 100.

When the user grasps at least one among the first and second touchpoints TP1 and TP2 and wears the electronic device 100 to enter thefirst state, the controller 140 may display related contents on theglasses 130. Namely, the controller 140 may display content in a mannerdifferent from that of the second state. When the user touches at leastone among the first and second touch points TP1 and TP2 or whenswitchover to the first state is completed, the controller 140 may stopdisplaying of the content using the projector 210.

When a touch is applied to at least one among the first and second touchpoints TP1 and TP2, the controller 140 may determine that a state of theelectronic device 100 is changed. For example, in a state in which theelectronic device 100 is not worn, when at least one of the first andsecond touch points TP1 and TP2 is touched, the controller 140 maydetermine that the electronic device 100 is changed to the first statein which the electronic device 100 is worn. A touch point may be aportion other than the first and second touch points TP1 and TP2. Forexample, a touch input applied to a front side or a rear side of theelectronic device 100 may be obtained.

The controller 140 may determine a state of the electronic device 100 bycombining the obtained other signal with a touch signal. For example,after a touch is applied to at least one of the first and second touchpoints TP1 and TP2, when a motion of picking up the electronic device100 is sensed, the controller 140 may determine that a state of theelectronic device 100 has been changed.

The controller 140 may perform different operations according to touchedpoints. For example, when the first touch point TP1 is touched, thecontroller 140 may display an image on a display close to the firsttouch point TP1, and when the second touch point TP2 is touched, thecontroller 140 may display an image on a display close to the secondtouch point TP2. The operation corresponding to the touched position mayalso be applied to a case in which the electronic device 100 is worn, ina similar manner.

As illustrated in (a) of FIG. 28, a plurality of events not checked bythe user yet may be on standby in the electronic device 100. Forexample, an unread message event and a missing call event may exist. Thepresence of the plurality of events may be indicated by a message iconI1, a call icon I2, and the like.

As illustrated in (b) of FIG. 28, the user may touch any one of thefirst and second touch points TP1 and TP2 depending on an event that theuser wants to check. For example, when the user touches the first touchpoint TP1, the controller 140 may display contents related to the callicon I2 at the first touch point TP1 side. When the user touches thesecond touch point TP2, the controller 1400 may display contents relatedto the message icon I1 at the second touch point TP2 side. Namely, whenthe user's touch applied to the electronic device 100 is sensed, thecontroller 140 may display contents related to the content correspondingto the touch operation.

The electronic device 100 may be more conveniently used by performing anoperation corresponding to a gesture input that the user may recognizeby intuition.

FIG. 29 is a flow chart illustrating a process of sensing the currentstate of the electronic device of FIG. 1, and FIG. 30 is a viewillustrating methods of sensing the current state of the electronicdevice of FIG. 1.

As illustrated, the current state of the electronic device 100 may bedetermined based on state information of the electronic device 100obtained directly and/or indirectly.

The controller 140 may sense a state of the electronic device 100through a direct and/or indirect means (S12).

The electronic device 100 may be in various states. For example, theelectronic device 100 may be in a state in which the user wears it ormay be in a state in which the user does not wear it. The electronicdevice 100 according to an embodiment of the present invention may be adevice worn on the user's face. Thus, a state in which the electronicdevice 100 is worn may be a state in which the eyeglass frame 161constituting the electronic device 100 are opened and coupled to theuser's face. A state in which the electronic device 100 is not worn mayinclude a state in which the electronic device 100 is placed on theground or may be held in the user's hand, rather than being on theuser's face.

A state of the electronic device 100 may be sensed through a directand/or indirect method. The direct and/or indirect methods for sensing astate of the electronic device 100 are illustrated in FIG. 30.

The direct method may be a method for sensing a state through a sensor.For example, a wearing state of the user may be directly sensed througha state of a wearing sensor, a camera, eyeglass frames, and the like.Information obtained by a direct sensing device may be firstinformation. The direct method may be relative accurate, but costs maybe relatively increased due to the attachment of sensors, or the like.

The indirect method may be a method other than sensing a state directlyby a sensor. For example, a wearing state of the user may be indirectlyestimated by estimating a time previously set by the user, whethercharging is performed, and the like. Information obtained by an indirectsensing device may be second information. Details of the direct methodand the indirect method will be described in relevant portionshereinafter.

The controller 140 may sense the current state by combining the sensedinformation (S14).

The sensed information may be at least one information. For example,there may be second information obtained by performing charging, inaddition to the first information obtained by the camera.

The controller 140 may determine whether the electronic device 100 isworn based on at least one of the first and second information.Combining information may provide a basis for more accuratelydetermining the current state of the electronic device 100. Namely,information based on a plurality of information, rather than singleinformation, may be more accurate.

By combining information, the current state of the electronic device 100may be sensed at relatively low costs. For example, since the currentstate of the electronic device 100 is determined by combininginformation obtained through an existing device installed in theelectronic device 100, rather than information obtained through sensors,or the like, increasing costs due to installation thereof, reliabilityof determination may be increased and an increase in manufacturing costsmay be minimized.

FIGS. 31 and 32 are views illustrating a sensing method using sensors inthe electronic device of FIG. 1.

As illustrated in FIGS. 31 and 32, whether the electronic device 100according to an embodiment of the present invention is worn may bedirectly sensed through wearing sensors 210 installed in the electronicdevice 100.

As illustrated in FIG. 31, the wearing sensors 210 may be positioned inportions in contact with the user's body as the electronic device 100 isworn. For example, a first sensor 212 may be positioned in an endportion of the leg of the eyeglass frame 161 directly in contact withthe user's head and/or a second sensor 214 may be positioned in aportion in contact with the user's nose.

The first and second sensors 212 and 214 may sense whether theelectronic device 100 is worn through a method such as sensing pressureapplied when the electronic device 100 is worn and/or sensing a changein an electromagnetic field generated when the electronic device 100 isbrought into contact with the user's body.

As illustrated in FIG. 32, information may be obtained from a motionsensor capable of sensing a user's motion in the electronic device 100.

The motion sensor may include an accelerometer, or the like. Thus, aquantity of motion generated due to a user's motion may be sensed.

The controller 140 may determine that the electronic device 100 is notworn between t1 and t2 and between t3 and t4 in which the quantity ofmotion is 0.

FIG. 33 is a view illustrating a sensing method using a camera in theelectronic device of FIG. 1.

As illustrated in FIG. 33, whether the electronic device 100 accordingto an embodiment of the present invention is worn may be sensed throughthe camera 110.

The camera 110 may be a device that may sense a state in which theelectronic device 100 is worn. Namely, the camera 110 may be one ofdirect sensing devices generating first information for determiningwhether the electronic device 100 is worn, by analyzing an image thatmay differ depending on whether the electronic device 100 is worn.

A first image VA1 captured through the camera 110 when the user wearsthe electronic device 100 and a second image VA2 captured through thecamera 110 when the electronic device 100 is placed on the ground may bedifferent. For example, the second image VA2 may be an image obtained bycapturing the same object for a predetermined period of time. Thecontroller 140 may determine whether the electronic device 100 is wornbased on a difference between captured images.

The controller 140 may determine whether information is accurate by thecamera 110 according to determination based on different information.For example, in case of information obtained through a motion sensor,when a motion of the electronic device 100 is not sensed for more than apredetermined period of time, capturing of an image may be attempted bythe camera 110. When there is no change in an imaged object according tothe result of the image capturing through the camera 110, the controller140 may determine that the electronic device 100 is not worn.

FIG. 34 is a view illustrating a sensing method according to states ofeyeglass frame of the electronic device of FIG. 1.

As illustrated in FIG. 34, the controller 140 of the electronic deviceaccording to an embodiment of the present invention may determinewhether the electronic device 100 is worn based on a state of theeyeglass frames 161.

As illustrated in (a) of FIG. 34, the eyeglass frames 161 of theelectronic device 100 may be in an unfolded state. Or, as illustrated in(b) through (d) of FIG. 34, at least one of the eyeglass frames 161 ofthe electronic device 100 may be in a folded state.

The controller 140 may sense a state of the eyeglass frames 161. Forexample, the controller 140 may sense whether the eyeglass frames 161are folded or unfolded through a frame sensor.

The controller 140 may sense a state of the electronic device 100 basedon whether the eyeglass frames 161 are folded. For example, when atleast one of the eyeglass frames 161 is folded, the controller 140 maydetermine that the electronic device 100 is not worn. However, when boththe eyeglass frames 161 are unfolded, the controller 140 may determinethat the electronic device 100 is worn.

FIG. 35 is a view illustrating a sensing method based on time in theelectronic device of FIG. 1.

As illustrated in FIG. 35, whether the electronic device 100 accordingto an embodiment of the present invention is worn may be determinedaccording to time set by the user and/or the controller 140.

The controller 140 may determine whether the electronic device 100according to an embodiment of the present invention is worn according toa pre-set time. For example, the controller 140 may determine that theelectronic device 100 is not worn within a time range set by the user asa non-wearing time, and the controller 140 may estimate that theelectronic device 100 is worn within a time range set by the user as awearing time.

The wearing time and non-wearing time may be applied by a user setting.Namely, when the user tends not to wear the electronic device 100 for aparticular period of time, the user may set the particular period oftime in advance to effectively use a battery of the electronic device100.

The wearing time and non-wearing time may be set by the controller 140.For example, the controller 140 may sense a period of time during whichthe electronic device 100 is used through a motion sensor, or the like.Upon sensing the period of time during which the electronic device 100is used, the controller 140 may schedule the period of time during whichthe electronic device 100 is used. The controller 140 may estimatewearing or non-wearing of the electronic device 100 within the timerange according to the scheduled time.

FIG. 36 is a view illustrating a sensing method based on charging in theelectronic device of FIG. 1.

As illustrated in FIG. 36, the controller 140 of the electronic device100 according to an embodiment of the present invention may determinewhether the electronic device 100 is worn based on whether theelectronic device 100 is being charged.

The electronic device 100 may need to be re-charged at predeterminedperiods according to a usage degree. The electronic device 100 may becharged through a charging device 300. For example, the electronicdevice 100 may be charged by connecting a charging line extending fromthe charging device 300 to the electronic device 100.

When charging is performed on the electronic device 100, the controller140 may determine that the electronic device 100 is not worn. This maybe based on inspection of a general usage aspect of the user withrespect to the electronic device 100.

The exemplary embodiments of the present invention will now be describedwith reference to the accompanying drawings, in which like numbers referto like elements throughout. In describing the present invention, if adetailed explanation for a related known function or construction isconsidered to unnecessarily divert the gist of the present invention,such explanation has been omitted but would be understood by thoseskilled in the art. The accompanying drawings of the present inventionaim to facilitate understanding of the present invention and should notbe construed as limited to the accompanying drawings. The technical ideaof the present invention should be interpreted to embrace all suchalterations, modifications, and variations in addition to theaccompanying drawings.

The invention claimed is:
 1. An electronic device comprising: a displaygenerating light; a first optical lens including: a first surface facingthe display, the first surface provided with the light from the display;and a second surface opposite to the first surface; a second opticallens including: a first surface facing the second surface of the firstoptical lens, the first surface of the second optical lens provided withthe light from the first optical lens; and a second surface opposite tothe first surface; a light guide including: an incidence surface facingthe second surface of the second optical lens, the incidence surfaceprovided with the light from the second surface of the second opticallens; a transmission surface spaced apart from the incidence surface,the transmission surface transmitting the light toward an outside of thelight guide; and a reflector facing both the incidence surface and thetransmission surface; a wearing sensor configured to sense whether theelectronic device is worn on a user; and a controller electricallyconnected to the wearing sensor and the second optical lens, thecontroller is configured to provide the second optical lens with acontrol signal based on a sensed value from the wearing sensor, whereinthe second optical lens is positioned between the first optical lens andthe light guide, wherein the incidence surface is positioned between thefirst optical lens and the transmission surface, and wherein a shape ofthe second optical lens is changed when the control signal is changed.2. The electronic device of claim 1, wherein a shape of the secondsurface of the second optical lens is changed when the control signal ischanged.
 3. The electronic device of claim 2, wherein when theelectronic device is not worn on the user, the controller determines aprojection surface in which an image is to be displayed, based on atleast one among a color and a material of a seating surface on which theelectronic device is placed.
 4. The electronic device of claim 1,wherein the second optical lens operates in at least one of a first modein which the light which has passed through the second optical lens isdiverged, a second mode in which the light which has passed through thesecond optical lens is converged, a third mode in which there is nochange in an optical path of the light before and after the light passesthrough the second optical lens, and a fourth mode in which the lightwhich has passed through the second optical lens is refracted in aparticular direction.
 5. The electronic device of claim 1, furthercomprising a camera configured to obtain an external image, wherein thecamera is electrically connected to both the wearing sensor and thecontroller, wherein the wearing sensor senses a current state among afirst state in which the electronic device is worn on the user and asecond state in which the electronic device is not worn on the user, andwherein the controller displays content in different manners inaccordance with the current state.
 6. The electronic device of claim 5,further comprising: a projector, wherein the controller projects thecontent toward a projection surface by using the projector in the secondstate.
 7. The electronic device of claim 6, wherein the controllerchanges at least one among a color, contrast, and brightness of theprojected content based on a state of the projection surface.
 8. Theelectronic device of claim 1, further comprising a frame coupled to atleast one point of a user's face to allow the electronic device to beworn on the user's face, wherein the controller is installed in theframe and is configured to determine whether the electronic device isworn on the user's face based on a first information obtained from adirect sensing device coupled to the frame, and wherein the directsensing device includes at least one of: a contact sensor electricallyconnected to the controller, the contact sensor is configured to contactthe user; a camera electrically connected to the controller; a framesensor electrically connected to the controller, the frame sensor isconfigured to sense a state of the frame; and a motion sensorelectrically connected to the controller, the motion sensor isconfigured to sense a movement of the electric device.
 9. The electronicdevice of claim 1, wherein the first surface of the second lens is flat.10. The electronic device of claim 1, wherein at least a portion of thelight is internally reflected totally from the incidence surface to thereflector.
 11. The electronic device of claim 8, wherein the controlleris configured to determine whether the electronic device in worn on theuser's face based on at least one among the first information and asecond information, and wherein the second information includesinformation whether the electronic device is being electrically charged.12. A method for controlling an electronic device including a display, afirst optical lens, a second optical lens, a wearing sensor configuredto sense whether the electronic device is worn on a user and a lightguide, wherein the second optical lens is positioned between the firstoptical lens and the light guide and wherein the second optical lensincludes a rear surface facing the light guide, the method comprising:sensing whether the electronic device is worn on a user's face by usingthe wearing sensor; when the electronic device is worn on the user'sface, forming the rear surface of the second optical lens in a firstshape for forming a first optical path from the display toward aneyeball of the user via the first optical lens, the second optical lens,and the light guide, sequentially; and when the electronic device is notworn on the user's face, forming the rear surface of the second opticallens in a second shape for forming a second optical path from thedisplay toward a projection surface formed on a seating surface on whichthe electronic device is placed, via the first optical lens, the secondoptical lens, and the light guide, sequentially, and wherein a shape ofthe second surface of the second optical lens corresponds to a sensedvalue from the wearing sensor.
 13. The method of claim 12, wherein theforming of the second optical path comprises: determining a position ofthe projection surface; and forming the shape of the second optical lensin accordance with the position of the projection surface.
 14. Themethod of claim 13, wherein the forming of the second optical pathcomprises: changing the projection surface based on at least one among acolor and a material of the projection surface.